Structure optimization of prior-knowledge-guided neural networks
نویسندگان
چکیده
Prior-knowledge use in neural networks, for example, knowledge of a physical system, allows network training to be tailored specific problems. Literature shows that prior-knowledge enhances predictive performance. Research date focuses on parametric optimization rather than structure optimization. We present new framework optimize the using prior-knowledge. This is achieved through optimizing number hidden units via line search and cross-validation empirical error eliminate data-set/model-structure application dependency guided networks. In addition model step, we propose utilizing prior errors as part performance index improve generalization. Results demonstrate proposed model’s prediction accuracy consistency convex data sets with unique minimum non-convex multi-modal sets. The presented results yield understanding physics-guided networks terms their structural
منابع مشابه
Integrating Statistical Prior Knowledge into Convolutional Neural Networks
In this work we show how to integrate prior statistical knowledge, obtained through principal components analysis (PCA), into a convolutional neural network in order to obtain robust predictions even when dealing with corrupted or noisy data. Our network architecture is trained end-to-end and includes a specifically designed layer which incorporates the dataset modes of variation discovered via...
متن کاملStructure optimization of neural networks for evolutionary design optimization
We study the use of neural networks (NN) as approximate models for fitness evaluation in evolutionary computation. To improve the quality of the NN models, structure optimization of these NNs is applied with respect to two different criteria: One is the commonly used approximation error, and the other is the ability of the NNs to learn different problems of a common class of problems. Simulatio...
متن کاملKnowledge-Guided Deep Fractal Neural Networks for Human Pose Estimation
Human pose estimation using deep neural networks aims to map input images with large variations into multiple body keypoints which must satisfy a set of geometric constraints and inter-dependency imposed by the human body model. This is a very challenging nonlinear manifold learning process in a very high dimensional feature space. We believe that the deep neural network, which is inherently an...
متن کاملStructure-guided forcefield optimization
Accurate modeling of biomolecular systems requires accurate forcefields. Widely used molecular mechanics (MM) forcefields obtain parameters from experimental data and quantum chemistry calculations on small molecules but do not have a clear way to take advantage of the information in high-resolution macromolecular structures. In contrast, knowledge-based methods largely ignore the physical chem...
متن کاملFeedforward Neural Networks – Architecture Optimization and Knowledge Extraction
Feedforward neural networks represent a well-established computational model, which can be used for solving complex tasks requiring large data sets. When dealing with this kind of problems, the main requirements will be the speed of the learning process and the ability to generalize well the extracted knowledge. To satisfy these demands, adequate initial parameters of the model – like number of...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2022
ISSN: ['0925-2312', '1872-8286']
DOI: https://doi.org/10.1016/j.neucom.2022.03.008